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ABSTRACT 


The Tactical Atmospheric Modeling System/Real Time (TAMS/RT) 
combines the high-resolution Coupled Ocean/Atmosphere Mesoscale Prediction 
System (COAMPS) and the Tactical Environmental Data Server (TEDS). 

In this study, we evaluate TAMS/RT sea level pressure, 10 meter (m) 
winds and 2 m air temperature fields generated at the Naval Pacific Meteorology 
Oceanography Center (NPMOC) in San Diego. We qualitatively compare outer 
nest (45 and 54 km) sea level pressure 12 and 24-hour forecasts with model 
analyses. Then we quantitatively compare surface observations with inner nest 
(5 and 6 km) model wind (u and v) and temperature forecast fields (00, 06, 12, 
18, and 24-hour). 

Contrary to expectations, we found no error growth through the forecast 
cycle and relatively high error in the initial analysis for ail variables. When 
examined by OOOOZ and 12002 model runs, we found a repetitive pattern related 
to the diurnal cycle which impact use by a forecaster. We link day to day error to 
the diurnal pattern and larger magnitude error to cold starts, background fields, 
and data assimilation problems. We observed high variability among observed 
and model values but still found various model trends that require further 
evaluation. 
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I. INTRODUCTION 


A. WHAT IS SO SPECIAL ABOUT MESOSCALE MODELS? 

The United States Naval Service maintains roles of deterrence, sea 
superiority, and the protection of maritime trade. However, in the past decade its 
focus has shifted from a global to regional emphasis highlighting littoral 
operations (NDP 1,1994). Recent technologicai improvements in mesoscale 
numerical weather models have increased the Navy’s interest in detailed, short¬ 
term forecasting (Hodur 1997). High-resolution topography and Graphical User 
Interface (GUI) displays provide a four-dimensional view of the surface and 
atmosphere, including depictions of jet streams, vertical motion, and moisture. 
Researchers are able to initialize mesoscale models with local and particular 
observations, and to experiment with specific analysis and/or model physics 
schemes unavailable to operational centers (Miller 1999). Meanwhile, 
forecasters are drawn to mesoscale models due to their ability to focus on areas 
of interest with higher resolutions. Mesoscale models capture many details of 
mesoscale phenomena (Doyle 1997, Warner 1992, Thompson et al 1997), 
nonetheless, questions remain about mesoscale model accuracy and their most 
appropriate use for forecast guidance. 

B. FORECASTER GUIDANCE USING MESOSCALE MODELS 

Forecasters need to understand model characteristics. When using a 
global model, a forecaster typically evaluates the model analysis with local 
observations, satellite images, and forecasts from another model or previous 
model run to determine how well a model is “handling” the synoptic situation. 
Then he/she takes the model forecast and applies rules of thumb about local 
topography and known model tendencies to produce a forecast. A forecaster’s 
skill is measured by how well he/she applies these local rules to recurring 
situations and how well he/she knows when not to believe the model output. 
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Can this same procedure be applied when using mesoscale models is a central 
issue motivating this study. 

C. PREDICTABILITY 

Predictability theory states that atmospheric predictability varies with time, 
seasons, geographic location, and synoptic pattern with error growing overtime. 
Moreover, smaller scales of atmospheric motion are forecast with less skill than 
larger scales due to inherent differences in the predictability error growth for 
different scales of motion (Anthes 1986). High-resolution alpha and beta 
mesoscale models (2 to 200 kilometers) imply “high-variability” within their 
domain (at least compared to global models). Variability increases under weak 
synoptic forcing. Typically, improving a forecast means reducing model error for 
all variables (wind, temperature, precipitation, etc.) throughout the entire domain. 
At present, it may be unrealistic to expect a high-resolution model to improve all 
variables, all the time, everywhere within the domain, especially under weak 
synoptic forcing. Model accuracy can be improved by reducing model error. Any 
attempt to improve the model forecast must explore the nature of model error. As 
a start, we should attempt to verify and to understand a model’s tendencies by 
learning how error for variables of interest varies over time and space. 

C. MODEL VERIFICATION 

Numerical models can be compared with a model-generated analysis or, 
with observations. When comparing mesoscale models with observations, the 
largest and most difficult verification problem is with the lack of mesoscale 
observations (Perkey 1986). In theory, observational data should be the most 
accurate picture of the atmosphere but could also lead to local effects not 
representative of a larger area. Also, the verification is biased towards areas 
where observations are available. On the other hand, verification of a model 
forecast with a model analysis is only as good as the model analysis. The 
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Cooperative Program for Operational Meteorology, Education and Training 
(COMET) Module provides an excellent description of the advantages and 
disadvantages of each scheme (COMET Numerical Prediction Module 1998). 

D. OBJECTIVES 

In this study, we use both verification methods to evaluate sea level 
pressure, 10 meter (m) winds and 2 m air temperature fields generated by the 
Tactical Atmospheric Modeling System/Real Time (TAMS/RT) located at the 
Naval Pacific Meteorology Oceanography Center (NPMOC) in San Diego. We 
examine error growth through the forecast cycle and relate it to predictability 
theory. In addition we look for model trends and characteristics. 
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II. MODEL DESCRIPTION 


The Naval Research Laboratory’s (NRL) TAMS/RT processes the 
atmospheric component of the Coupled Ocean/Atmosphere Mesoscale 
Prediction System (COAMPS). COAMPS is a triple-nested non-hydrostatic 
mesoscale model using a multi-variate optimum interpolation (MVOI) data 
interpolation scheme. Features include a globally relocatable grid, user-defined 
grid resolutions and dimensions, nested grids, an option for idealized or real-time 
simulations, and code which allows for portability between mainframes and 
workstations. It derives its initial and lateral boundary condition fields from the 
Navy Operational Global Atmospheric Prediction System (NOGAPS) run at Fleet 
Numerical Meteorology and Oceanography Center (FNMOC). When the model 
is initialized directly from a NOGAPS analysis or forecast, the process is called a 
"cold start" (Hodur 1997). 

TAMS/RT also Includes the Tactical Environmental Data Server (TEDS). 
TEDS allows independent ingest of local observations and satellite-derived 
observations and boundary conditions from a central or regional center and 
maintains an on-site data assimilation, nowcast, and forecast capability. A 
unique feature of TAMS/RT compared with other mesoscale modeling systems is 
the ability to operate in data assimilation mode - feeding observations into the 
COAMPS forecast cycle. In the mesoscale data assimilation scheme, the 
previous model forecast is used as a starting point and the observed data is 
incorporated in order to initialize the next model forecast. This process or, "warm 
start," is repeated every 12 hours and, although not verified, is considered the 
ideal method of initializing a model run. The TAMS/RT nowcast is when this 
cycle is used to regularly update just the local model forecast field using the 
analysis (without a subsequent forecast). This nowcast feature is designed to 
automatically maintain a database containing the best estimate of the current 
environmental conditions within the domain (TAMS/RT homepage, 1999). 

Reiss (1999) provides an excellent summary of NPMOC’s TAMS/RT 
system characteristics and specific configurations (Table I). 
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III. METHODS 


A. TECHNIQUE 

From 22 March to 22 September 1999, we analyzed inner nest 5 and 6 
kilometer (km) wind and temperature analyses and forecast grid fields. Outer 
nest 45 and 54 km sea level pressure fields were examined from 11 May to 22 
September 1999. NPMOC defined the outer, middle, and inner nests as 45,15, 
and 5 kms before 18 June, and 54,18, and 6 kms afterwards (Fig. 1). 

Both 0000 UTC and 1200 UTC (hereafter OOz and 12z) model run 
analysis and forecast grid files were transferred via file transfer protocol (ftp) 
daily to the Naval Postgraduate School (NPS) with back-up 4mm magnetic tapes 
sent to NPS bimonthly. Surface and ship observations are continuously received 
and archived at NPS. 

VISUAL, a FORTRAN-coded diagnostic and display program (Nuss and 
Drake 1995), was used to plot sea level pressure fields for outer and middle 
nests for 12 and 24-hour forecasts. Additionally, VISUAL was used to plot and 
compare surface observations with model wind and temperature fields for the 
inner nest for analysis, 6, 12,18, and 24-hour forecasts (hereafter referred as 
fOO, f06, f12, f18, f24, respectively). These computed differences were saved for 
subsequent statistical analysis. In all cases both OOz and 12z model runs were 
examined. 

FORTRAN and MATLAB programs were used to sort and file data, 
compute statistics, and create time series plots. Microsoft EXCEL was used to 
create spreadsheets and scatter plots for monthly and station analysis. Other 
information used to compare with VISUAL plots includes high-resolution (4 km) 
satellite imagery and NPMOC and National Weather Service forecast 
discussions. 
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B. TERMINOLOGY 


To avoid confusion, model runs will be referred to as OOz or 12z while 
valid times will be listed as either 0000, 0600,1200, or 1800 UTC. Throughout 
this report we refer to specific forecasts of a certain model run using the following 
notation: 

29/12z f18 = 29 (day) / 12z (model run) f18 (18-hour forecast) 

OOz fOO = OOz model run, analysis 

12z f06 = 12z model run, 6-hour forecast 

OOz f24 = OOz model run, 24-hour forecast, and so on. 

C. SEA LEVEL PRESSURE COMPARISON 

To qualitatively assess if mesoscale error fluctuations corresponded to 
synoptic-scale error, 12 and 24 hour forecast sea level pressure fields were 
compared with the verifying model analysis. These plots were generated for 
both OOz and 12z model runs, for both outer and middle nests. 

San Diego and the Southern California (SOCAL) bight were used as 
benchmarks to determine forecast fit for the outer domain. Isobars at 2 millibar 
(mb) intervals were examined and the difference between model and analysis 
isobars was measured in the SOCAL area. OOz and 12z model runs at 12 and 
24-hour forecasts were compared for "best fit" or lowest pressure difference 
between forecast and analysis. In addition, the tendency for the model to have 
either higher or lower pressure compared to the analysis was recorded. 

D. WIND AND TEMPERATURE COMPARISONS: 

OBSERVATION - MODEL = ERROR 

East/west (u) and north/south (v) wind vectors at 10 meter height, and 2 
meter air temperature variables were compared by subtracting model from 
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corresponding observed values (observation - model = error). A two- 
dimensional multi-quadratic interpolation scheme was used to interpolate grid 
points to observations (Nuss and Titley 1994). VISUAL plots show wind and air 
temperature fields along with error values for temperature and wind speed and 
direction error vectors for each reporting station (Fig. 2). Below is an example of 
wind vector and station error notation on VISUAL plots: 

Observed (Temp Error) 

(Station) 

(Wind Vector/Speed error) 




Approximately 40 surface reporting stations are within the inner nest 
domain with 8 to approximately 36 stations reporting at any given forecast 
validation time. Ship reports were received sporadically and incorporated into the 
data set. Figure 3 shows the 5 km nest SOCAL topography with a sample of 
some reporting stations. 

E. DATA ASSIMILATION 


Data assimilation information was gathered for most of August and 
September and retrieved from NRL’s TAMS/RT web page (NRL TAMS/RT web 
page). In assessing the impact on error growth we designated two categories of 
data assimilation. Full data assimilation included: rawinsonde observations 
(raobs), surface observations, satellite winds, pibals. Special Sensor 
Microwave/Imager (SSM/I) winds, aircraft reports, and NOGAPS generated 
rawinsonde observations (pseudo-raobs). Limited data assimilation included the 
same data as full, except for raobs and surface observations. 

F. TIME SERIES PLOTS 


Time series plots of daily averages of u, v, and temperature were 
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generated for selected forecasts (fOO, f06, f12, f18, and f24) and time periods (by 
season and by month). The purpose of the time series was to show error 
variability overtime and outline periods when errors were greatest in order to 
examine possible relationships and sources of error. 
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IV. RESULTS 


A. SYNOPTIC PATTERN 


In April, several low pressure systems moved across California and the 
Pacific Northwest. For most of May to September a summertime synoptic 
pattern dominated. This pattern consists of a strong semi-permanent East 
Pacific high pressure system that interacts with a low pressure trough extending 
north from Mexico across California (NPMOC Forecasters Handbook). The 
resulting pressure gradient was typically west to east along the West Coast. 

Throughout the sampling period, local and remote data ingest into TEDS 
varied considerably as did the TAMS/RT initialization routine (warm versus cold 
start). Due to a TEDS malfunction, there was a documented period of very 
limited data assimilation (NOGAPS pseudo-raobs only) and frequent cold starts 
(2-3 times per week) from 7 to 20 April. 

Seasonal analysis varied from 22 March to 17 June (spring), and 18 June 
to 22 September (summer). We chose 18, rather than 22 June since it 
corresponded with NPMOC’s shift from a 5 to 6 km inner nest grid (on OOz model 
run). 


B. SEA LEVEL PRESSURE COMPARISON 

Throughout the study period, the outer nest sea level pressure forecasts 
performed remarkably well. For the most part, major features were captured and 
isobars, especially over water, paralleled and closely followed the analyses. 

Figure 4 is an example of analysis and verifying 12 and 24-hour forecast 
of TAMS/RT sea level pressure for the outer nest (54 km resolution). Using the 
SOCAL area as a benchmark, this example for the OOz model run on 28 August 
shows that both forecasts capture the major synoptic features, however, f24 
does a better job with the central pressure of the thermal low over southwestern 
Arizona. In the 28/OOz f12, analysis sea level pressure over the San Diego area 
is approximately 1012-13 millibars (mb) while forecast pressure is 1010-11 mb. 
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Meanwhile, the 28/OOz f24 analysis shows 1012 mb while the forecast has 1010- 
11 mb. Other criteria to assess best fit include the distance between forecast 
and analysis isobars. In Figure 4, the distance between the 1012 mb isobars 
over the San Diego area is approximately 65 nautical miles (nm) for the f12 and 
less than 40 nm for the f24. In this case, the f24 has a better fit for outer nest 
sea level pressures in the SOCAL area. 

Similar observations were noted from May to September along with the 
percentage of times that f12 (or f24) gave a better pressure forecast than f24 (or 
f12). Table II outlines these results including a qualitative assessment of best fit 
between model forecast and verifying analysis. 

Clearly, the 12z f12 gave the best SOCAL sea level pressure forecast 
(94% better fit than f24) followed by the OOz f24 (65% better fit than f12). Both 
these forecasts were valid at 0000 UTC or 1700 local, corresponding to the 
warm portion of the diurnal cycle when surface pressures are expected to lower 
over land. On the other hand, the OOz f12 and 12z f24 consistently gave a worse 
fit, with 1-4 mb lower sea level pressures 95% of the time. Both these forecasts 
were valid at 1200 UTC or 0500 local and correspond to the cold part of the 
diurnal cycle when pressures over land increase. For the cases where the model 
forecasted equal or higher pressures, values ranged from 0-2 mb. 

These results suggest that TAMS/RT is not resolving diurnal effects. 

Using Figure 4 as an example, the 28/OOz f24 is valid at 0000 UTC (warm cycle) 
and shows good agreement between forecast and analysis with placement and 
central pressure for the Arizona thermal low. At night, the thermal low fills 
slightly and the OOz f24 valid 1200 UTC (cold cycle) shows that the forecast has 
pushed the trough too far to'the west and has the central pressure 2 mb lower 
than the analysis. This is most likely due to coarse model resolution, especially 
of the coastal topography. Thus, the model does not “feel” the coast and pushes 
the trough offshore resulting in a tighter west/east pressure gradient that is offset 
from the analysis. 

C. SEASONAL COMPARISON 

Figures 5a, b, c, d, depict analysis (fOO) and forecast (f24) time series 
plots for spring and summer for both (OOz and 12z) model runs. They show 
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mean daily bias averaged from all the stations that reported within the inner nest 
for that verifying time, along with corresponding standard deviation and Root 
Mean Square (RMS) error. 

April, June and August had distinct periods of high temperature error while 
high wind error occurred in April, nearly concurrent with the period of increased 
temperature error (Figs. 5a, b, c, d). Specifically, high positive u error, increased 
variability in v error, and high negative temperature error occurred between 10 to 
20 April in the analysis and persisted throughout the forecast cycle. In June, 
high negative temperature error is evident on the 14 June analysis (fOO) with no 
noticeable change in wind error and again, persisted throughout the forecast. 

The third noticeable instance of high negative temperature error occurred 
between 27 and 30 August with no apparent change in wind error. This high 
negative error did not appear in the forecast. These three cases will be examined 
more closely later. 

Figure 6 shows that there was no error growth in the forecast cycle for u, v 
or T, in either spring or summer. This finding contradicts our expectation from 
predictability theory that error starts small and will grow during the forecast cycle 
(Anthes and Baumhefner 1986). We found that error starts high and both error 
and variability remain high throughout the forecast. 

Temperature and north/south (v) wind error was larger in spring than in 
summer, probably due to stronger synoptic forcing in spring. East/west error was 
larger in summer due to a more prevalent sea/land breeze circulation. A positive 
bias for all variables for all forecasts (recalling that observations - model = error), 
indicates that overall, TAMS/RT underforecast wind speed and temperature in 
both spring and summer months. However the large variability shown by the 
error bars for v and T (u is not shown but is of similar magnitude) and high RMS 
indicates that there were many variations (Fig. 6). Highest temperature errors in 
spring and summer occurred atf06 and f18 and again hint at a model problem 
with resolving the diurnal cycle since part of these forecasts (depending on 
model run) are valid at 1800 UTC (warm cycle). 

V error also peaked at f06 and f18 implying there may be a similar link to 
the diurnal cycle. All variables reflect relatively large daily variability that is most 
likely due to topographical flow and differential heating of land and sea within the 
domain. 
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Figure 6 also shows that the occurrence of minimum error is different for v 
than for u and T. This is probably a reflection of seasonal change between 
greater synoptic forcing in spring when more major frontal systems are 
influencing the area, and less in summer when there is a weaker north/south 
component and a steady west/east pressure gradient. 

D. MODEL RUN COMPARISON 

The spring and summer error distribution observed in Figure 6 led us to 
think there might be a relationship between error growth/decay and the diurnal 
cycle. We examined the averages of monthly error averages from 1 April to 22 
September for each forecast of each model run (OOz and 12z). The result, (Fig. 
7), clearly shows a different trend than that observed with combined model runs 
in Fig 6. 

All three variables followed a distinctive pattern of error growth/decay that 
repeats itself 12 hours later in the following model run. Between the maximum 
and minimum values, u, v, and T profiles for both model runs follow nearly 
identical paths. Highest errors for u and T occurred during the warm portion of 
the diurnal cycle when westerly winds predominate and temperatures are at their 
maximum. 

Temperature had the largest errors with maximum values of 3.2 to 3.4 
degrees Centigrade (°C) occurring at 1800 UTC, or 1100 local (verifying forecast: 
OOz f18 and 12z f06). When these errors are compared to average observed 
temperature, they account for about 16% of the observed mean value (Fig. 7). 
Minimum temperature errors were at 1200 UTC, or 0500 local (OOz f12 and 12z 
fOO) when temperatures are lowest and are about 4% of the observed mean. 

East/west or u error followed a similar error pattern with maximum error of 
0.8 to 1.0 meters per second (m/s) at 1800 UTC (OOz f18 and 12z f06) that 
provides 48-52% of the observed mean value. Minimum values of 0.25 to 0.35 
m/s, occurred at 0600 UTC, or 2300 local (OOz f06 and 12z f18) and account for 
16-21% of observed mean value. 

The north/south or v wind component had the smallest errors and followed 
a similar but less obvious pattern. The range between error values was 0.2 to 
0.6 m/s with a maximum at 1800 UTC (OOz f18 and 12z f06) and corresponded 
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to 70-76% of the observed mean value. Minimum v error of 0.19 and 0.22 m/s 
occurred at 0000 UTC (OOz f24 and 12z f12) and accounts for 24-28% of the 
observed mean value. 

Overall, the resulting pattern is all errors decreased as temperatures 
cooled and increased with warming. A possible explanation for this trend and its 
relationship to model topography will be discussed in the next chapter. 

E. INITIAL ERROR 

Table III compares RMS error and initial bias (fOO) to the corresponding 
observed u, v, and T average observed values. For u and v, the bias is not really 
wind speed dependent while the temperature bias is temperature dependent. 

Figure 7 gives the impression that the inner nest 12z analysis (fOO) values 
are low, Table III shows that relative bias at time of initialization Is high for both 
model runs, especially the 12z model run. In addition, the large u and v RMS 
error show that the magnitude of the absolute error is very high for the analyses 
of both model runs. 

F. AVERAGE WIND ERROR 

In a southern California summer regime, winds offshore are typically 
northwesterly. During the day, they become more southwesterly along the coast 
and a steep coastal thermal gradient creates a strong onshore sea breeze 
(NPMOC Forecasters Handbook, 1995). Further inland, complex topography 
modifies the wind flow. 

Table IV outlines observed and model average wind vector (u, v) direction 
along with combined average wind direction and speed for all stations. At all 
times and for both model runs, the model underforecast the predominant 
westerly wind component. For the north/south component, the model 
underforecast the stronger daytime southerly flow and overforecast the light, 
nighttime northerly flow. This pattern further demonstrates the diurnal character 
of the wind flow. 
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G. VARIABILITY 

It is important to note that there is high variability behind these results. 
Although variability is low among the monthly averages in Figure 7 (error bars 
are not displayed), there is a large amount of variability in the data used to 
compute each monthly average (monthly values range from 2-3 m/s and 2-4 °C). 

Figure 8 shows that model variability is in the same range as the observed 
variability, however there are some significant differences. During the warmest 
part of the day (1800 and 0000 UTC), the model displays less variability than the 
observed atmosphere. At the coolest part of the night (1200 UTC), the opposite 
occurs and the model has more variation than observed, for both temperature 
and wind. In this case, the model’s lack of diurnal forcing and smoother-than- 
real topography allows greater variation in the wind flow than the actual 
topography permits, especially over inland areas. 

H. MODEL TOPOGRAPHY VERSUS ACTUAL 

The variability differences between model and observed values may result 
from model topography that is smoother than real. Figure 3 shows model 
topography for the inner nest and Table V is a comparison of model and actual 
elevation for some of the inland stations within the inner nest. Using a 6.5 ®C per 
1 km lapse rate, the difference between model temperature and actual may 
range from 3 to 5 °C. This would account for the consistent temperature bias 
shown for the analysis in Table III at OOz but does not fit the lower temperature 
bias at 12z. The tendency for a cold model bias inland would generally result in 
a weaker sea breeze and low wind variation during the warm times. 

I. RECAPITULATION 

So far, we have demonstrated the following: 

- Error in the initial conditions is not reflective of forecast error. 

- The pattern of error growth and decay is a reflection of the model 
producing a weak warming and cooling cycle over land (low amplitude). 

- The model does not capture all the daytime variability in wind and 
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temperature nor does it accurately follow the diurnal cycle and that this is 
probably related to differences between the model and actual topography. 

At this point, we would like to present some specific examples that will 
give further insight into the nature of the relationship of the diurnal cycle and 
observed error pattern. 
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V. CASE STUDIES 


A. SYNOPTIC INFLUENCE ON MESOSCALE FORECAST 

The general consensus among forecasters is that synoptic error is 
correlated to mesoscale error (Gunderson 1998). A good synoptic fit should lead 
to a good mesoscale forecast. We present three outer nest examples of model 
runs with a good synoptic scale sea level pressure fit for which the corresponding 
mesoscale forecast showed large errors, especially with temperature. If we 
assume that synoptic scale temperature is also well fit, then the high error 
displayed in April, June, and August (Fig. 5) contradict the notion that a good 
synoptic fit implies a good mesoscale analysis and forecast. 

On 11 and 12 April a low pressure system moved across SOCAL. Figure 
9 depicts the outer nest 11 April OOz f12 and verifying 122 model run analysis. 
Although central pressures for both the depression located over northern 
California and the ridge over SOCAL are off by 2 mb, it appears that the model 
had a relatively good handle of synoptic features and sea level pressure 
distribution. The VISUAL plots of the inner nest (Figs. 10 and 11) show high 
temperature errors of 1 to 8 °C inland, and 0 to 4 °C along the coast (11/OOz f12 
and 11/12z fOO). Six hours, later both 11/OOz f18 and 11/12z f06 show even 
higher temperature errors (6 to 11°C inland and 1 to 5 °C along the coast) along 
with wind speed and direction errors, namely over the interior regions. For this 
case, high error was probably related to frequent cold starts, strong synoptic 
forcing and very limited data assimilation. 

Figure 12 shows that the 13 June 122 f12 valid on 14/OOz verified very 
well with the analysis. On 14 June, Figure 5 shows that there was a large 
negative temperature error for both model runs that persisted through the 
forecast. 

Finally, Figure 4 shows the 28 August OOz analysis, f12 and f24. Both 
forecasts capture major synoptic features although the f24 does a better job with 
central pressures. Again, Figure 5 shows that high temperature errors occurred 
during this period. 
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Assuming synoptic scale pressure is positively correlated to synoptic scale 
temperature, these examples show that: 

- Good synoptic fit does not ensure a good mesoscale forecast. 

Most of the synoptic scale cases observed during this study verified 
remarkably well and gave little to no indication of the magnitude of mesoscale 
error. 

B. APRIL 

April shows the effects of cold starts, warm starts with very limited data 
assimilation, and the possible effects of lateral boundary conditions on the inner 
nest. Considerable synoptic scale activity dominated the month. Various low 
pressure systems moved across the central and northwest coast of the United 
States, some of which influenced the SOCAL region. Figure 5a shows that high 
u, V, and temperature errors occurred from about 10 to 30 April. During that 
time, there was a period of very limited data ingest (NOGAPS pseudo-raobs 
only) into TAMS/RT due to a TEDS malfunction that lasted from 7 to 20 April. As 
a result, NRL recommended that NPMOC cold start the TAMS/RT 2 to 3 times 
per week. 

Figure 10 shows 11 April OOz f12 and f18 VISUAL plots while Figure 11 
portrays 11 April 12z fOO and f06 plots. Figure 10 plots are valid at the same 
time as Figure 11. With a warm start and very limited data assimilation, it is not 
surprising that the OOz f12 and 12z fOO are identical. Shown also, are the OOz 
f18 and 12z f06, valid six hours later. Over land, the wind and temperature fields 
are very similar and continue to have high errors. This shows a comparable 
handling by the model of surface heating and topography. Offshore, wind flow 
has changed notably from southwesterly to southerly in the southwest comer of 
the inner nest (around San Clemente Island). This difference is probably due to 
one or more of the following: the influence of NOGAPS pseudo-raobs which may 
introduce a NOGAPS bias such as warm inland temperatures into the model run 
(Nuss pers.comm.), the influence of lateral boundary conditions (updated every 
12 hours) that could possibly contaminate the forecast especially with a rapidiy 
evoiving synoptic situation such as in this case (Sashegyi and Madala 1992), or, 
the difference in adjustment time of the model from its initiaiization. Although 
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inconclusive as to which depiction of offshore flow is better, the Santa Catalina 
buoy (4602) indicates that the OOz f18 forecast captured the wind direction at 
that location better than the 12z f06. This example points out that: 

- The effect of lateral boundary conditions and NOGAPS pseudo-raobs 
on error growth needs to be investigated. 

- Major adjustments in offshore wind flow can have little impact on 
coastal and inland temperature and wind fields. 

C. AUGUST AND SEPTEMBER 

August and September are examples of the effects of cold and warm 
starts including both detrimental and possibly beneficial aspects of data 
assimilation. 

In early August there were frequent TAMS/RT system crashes along with 
a NPS server problem. Figures 13 and 14 are time series for August and 
September analyses (fOO) for both model runs with days of full and limited data 
ingest highlighted (see Methods section for a definition of “full” and “limited” data 
ingest). 

There is more variability in temperature error for both model runs in 
August than in September. Initial (fOO) error distribution in September follows the 
average trend (Fig. 7) of higher error at OOz than 12z. In August, OOz mean error 
or bias followed the average trend of colder temperatures than observed, but the 
overall bias for the 12z model run was actually negative indicating that on 
average the model temperature was too warm. Closer examination of Figure 14 
indicates that two peaks (16 and 26-31 August) skew the bias negatively. 

1. 16 August Episode 

The negative temperature error peak on 16 August was most likely 
caused by a poor background field following a cold start after a system crash of 
the previous 16 August OOz model run. Figure 15 shows that on 16 August, the 
12z fOO analysis had a smoothed temperature field with light offshore flow and 
high wind and temperature errors throughout the domain. Six hours later, the 
model developed a more realistic temperature and wind flow pattern; errors were 
lower and temperature was again too cold but in accordance with the average 
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trend (Fig. 7). The 12z model run initialized with limited data assimilation (no 
surface observations or raobs) and either a NOGAPS 12-hour forecast or the 
previous TAMS/RT 24-hour forecast, whichever the case, it forced the 
initialization to be too warm. Figure 16 shows the 12-hour forecast and 
corresponding analysis from the following model run. Only limited data 
assimilation took place. Clearly, the 16/12z f12 and 17/OOz fOO wind and 
temperature fields are identical. This example shows the following: 

- A cold start can introduce large errors into the analysis through the 
background field. 

- Six hours after a cold start with a poor background field, the model has 
developed a more realistic wind and temperature field. Model physics 
along with the diurnally cycle maintains the error pattern previously 
described. 

- In a warm start, errors present in the background field or 12-hour 
forecast are carried into the next model run. Those errors follow a 
repetitive pattern related to the diurnal cycle that repeats itself every 
24 hours. 

- With limited data assimilation, the model quickly recovered and within 
one model run of the high error episode, was back to the norm 
observed in Figure 7. 

2 . 26 August Episode 

Between 26 to 30 August, OOz and 12z model runs displayed a broad 
negative temperature peak. Previously, both 26/12z and 27/OOz model runs had 
crashed and either the background field and/or the full data assimilation scheme 
that occurred during this time, introduced high negative temperature errors into 
the 27/12z model run. Contrary to the 16 August case, this negative bias 
actually got worse before gradually returning to the norm by 31/OOz. This is an 
example of data assimilation leading to increased analysis errors. 

Figure 2 shows how the model, by 12 hours, has developed a realistic 
depiction of the thermal gradient and wind flow (27/12z f12). However, when 
used as a background field to warm start the following model run with full data 
assimilation, the analysis (28/OOz fOO) has lost the high temperature resolution 
and both wind and temperature errors are high throughout the domain. A warm 
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start initiated this model run and therefore the only explanation is NOGAPS- 
smoothing (from pseudo-raobs) that has destroyed any detailed mesoscale 
structure. 

This pattern of high- resolution 12-hour forecasts leading to low- 
resolution analyses due to poor data assimilation at initialization (warm start) 
continued through 6 model runs. 

Effects of poor initialization are further highlighted in time series of 
forecasts for individual stations. Figures 17a and 17b are time series for inner 
nest model and observed u, v, and T, for 28/12z and 29/OOz model runs for both 
North Island (San Diego) and Riverside (inland valley). Notice the differences 
between the 28/12z f12 and 29/OOz fOO values. At North Island, u remains the 
same, v improves, and T worsens. At Riverside, u, v, and T all worsen. These 
differences in the analysis are presumably due to data assimilation. Comparing 
28/12z f24 and 29/OOz f12. North Island u and T improved while v worsened, 
meanwhile at Riverside ail variables improved. This pattern of reduced forecast 
errors for Riverside (u, v, and T) after full data assimilation and high analysis 
errors, warrants further investigation. 

- Data assimilation (or the assimilation of unrepresentative data) can 
increase the time it takes for the model to recover from high initial 
errors (i.e., return to mean levels). If the data introduced into the 
initialization smooths the analysis, then it will take longer for model 
physics and diurnal tendencies to restore a high level of structure to 
the forecast. 

- In a warm start, large-scale data assimilation (i.e., from the global 
model) can smooth out any fine scale thermal structure that was 
present in the background field. Any fine detail observations will 
probably be lost from the effects of the large-scale circulation analyzed 
aloft (Hovermale 1986). 

- Data assimilation can affect u, v, and T differently at different locations 
within the domain. Data assimilation can be weighted towards 
improving certain variables in certain locations under certain 
circumstances. The example with North Island and Riverside 
highlights the complexities of mesoscale forecasting and analysis. 
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3. September 

September may be an example of a beneficial data assimilation 
procedure. Figure 14 shows that during most of September full data assimilation 
took place. On the two documented occasions (2-3 and 9 September) of limited 
data assimilation, the temperature bias increased. Regardless, even with full 
data assimilation, the monthly bias was in agreement with overall average 
temperature bias for the entire study period (Fig. 7). 

Interestingly, after a series of system crashes on 18-19 September, the 
following model run initialized using full data assimilation and had an average 
daily error only slightly above the monthly bias. 

- Data assimilation with surface and rawinsonde observations (i.e., full 
data assimilation) may produce lower initial errors than without (i.e., 
limited data assimilation). 

4. Inland/Coastal Comparison 

To assess which region, inland or coastal, contributed higher errors in 
August, we examined temperature time series (analysis) for stations in the San 
Diego area and inland regions (Fig. 18). San Diego stations display similar 
biases as that observed during August for all stations (Fig. 13) with little variation 
between the 5 to 7 reporting stations. Meanwhile, inland stations have much 
larger positive (OOz) and negative (12z) bias and larger variation (9 to 11 stations 
reporting) that is reflected in both model runs. 

- Under weak synoptic forcing and terrestrial heating, inland areas 
contribute the largest errors within the domain. 

D. RIVERSIDE 

To show the impact of topography on temperature error we plotted the 
spring and summer temperature error distribution for Riverside for both model 
runs (Fig. 19). Riverside is located on an elevated plateau between the Santa 
Ana and San Bernardino mountains, approximately 35 nm from the coast. 

Error trends in the Riverside forecast cycle are similar to all stations 
averaged (Fig. 7). The range of error is higher at Riverside in both spring and 
summer. Spring temperature bias is too cold throughout the forecast. In 
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summer however, the model has a cold bias at all times except 1200 UTC, when 
model temperatures are consistently too warm. 

As shown previously (Table V), model elevation at Riverside is too high 
making model temperature values too cold. Attempting to reduce the cold bias 
by correcting for elevation (623 meter difference) produces approximately 3 °C 
difference. Using Figure 19, applying a 3 °C correction improves the 
temperature forecast during the day. However, applying the same correction at 
night actually makes the error worse since the model now has a warm bias. 

- The model is poorly capturing the diurnal cycle over inland areas; it is 
too cold during the day and too warm at night. 

- For inland areas, correcting for elevation improves a daytime 
temperature forecast but worsens a nighttime one. 

E. AVERAGE TRENDS: 22 MARCH TO 22 SEPTEMBER 1999 

The following is a collection of the average trends observed during this study: 

1. Synoptic scale forecasts (outer nest) valid during the warm cycle (0000 UTC) 
give the best sea level pressure forecasts. This is when the model has the 
best handle on placement and central pressure of the thermal low. 

2. Synoptic scale forecasts (outer nest) valid during the cold cycle (1200 UTC) 
underforecast sea level pressures. The coarse resolution of the model’s 
outer domain does not allow it to differentiate the coastline and pushes the 
thermal trough too far west. 

3. Inner nest bias is greatest during the warm cycle, lowest during the cold 
cycle. 

4. Inner nest bias is greater over inland areas in summer. 

5. The model has a cold bias throughout the inner nest with the following 
exception noted below. 

6. In summer, differences between real and model terrain height compound the 
temperature problem in that the model is too cold during the day and too 
warm at night in the inland region. This in turn might impact the diurnal cycle. 

7. Inner nest initial and forecast wind errors for either model run are relatively 
high when compared to average observed wind. Error contribution varies 
from 20 to over 200%. 


25 



8. Inner nest TAMS/RT average forecast east/west (u) wind values are 
consistently lower than observed. Inaccurate model topography is most likely 
the cause. 

9. The north/south (v) wind component is underforecasted when winds are from 
the south (daytime) and overforecasted when from the north (light winds at 
night). 

Caveat Emptor! The high variability observed in both observed and 
model averages ensures frequent exceptions to these trends. 
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VI. DISCUSSION AND SUMMARY 


A. ERROR GROWTH AND THE DIURNAL CYCLE 

1. The Diurnal Cycle 

Most of the mesoscale processes observed in this study were weakly 
forced, namely in the form of mountain-valley and thermally forced circulations 
between the sea and differentially heated land surfaces. 

TAMS/RT captures the basic diurnal pattern, but variations between 
model and observed surface heat fluxes over land create and sustain errors 
throughout the forecast period. These errors are greatest during the warming 
cycle and lower during the cooling cycle and are independent of analysis error or 
forecast time. They are largest over inland areas. When a 12-hour forecast is 
used as a background field for the following analysis, these errors are carried 
into the next model run. A OOz 12-hour forecast consistently introduces relatively 
small errors into the next model run while 12z 12-hour forecasts introduce 
relatively large errors. Thus, the repetitive nature of error growth/decay 
continues in conjunction with the diurnal cycle. 

Other mesoscale phenomena (mountain-valley circulation, cold air 
damming, etc.) also contribute to error growth, especially inland. Smoother-than- 
real model topography and inaccurate model elevation contributes to the wind 
and temperature error distribution. Model elevation that is more or less than 
reality creates a different diurnal temperature pattern than observed which in turn 
creates a different wind field. 

2. Error Growth 

In this study, we did not observe standard error growth with respect to 
time as expected from predictability theory (Anthes 1986). With relatively large 
initial errors, we observed no error growth over the 24-hour forecast cycle. 
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Anthes (1986), reports that he and other researchers have also found no error 
growth using limited area models. 

Using time series, we observed large and small-magnitude errors. Large- 
magnitude error occurred three times during the study, two of which persisted 
throughout the forecast. In each of those cases, there was a relatively good 
synoptic fit between forecast and verifying analysis with no indication of high 
mesoscale errors. Small-magnitude error occurred day to day and is related to 
the diurnal cycle. Specifically, we examined OOz and 12z model run error and 
found there is a distinct, repetitive pattern to error growth/decay that is related to 
diurnal warming and cooling over land. Also related to the diurnal cycle is the 
pattern of model and observed variability. 

Data assimilation can reduce or increase error depending on the quality of 
the data, time of day, and region within the domain. Data assimilation can 
introduce large-magnitude errors into the analysis disrupting any mesoscaie 
definition contained in the background field. In one such case, we observed a 
reduction in forecast error at one location while at another, error increased for 
one variable and decreased for another. This example highlights some of the 
complexities involved in using mesoscale models and how forecasters and 
researchers need to re-characterize the meaning of an “improved” forecast to 
mirror the high-variability on the mesoscale and to assess dynamically important 
errors. 

A poorly defined background field can also introduce large-magnitude 
errors into the analysis following a cold start. Sometimes TAMS/RT uses a 12- 
hour NOGAPS forecast, other times it uses a 24-hour COAMPS forecast. On 
one hand, in a synoptically forced situation, a NOGAPS forecast probably has a 
better depiction of large-scale features (fronts, etc.). On the other hand, a 24- 
hour COAMPS forecast will contain more mesoscale detail than NOGAPS with 
about the same magnitude of error as a previous COAMPS 12-hour forecast 
would have had. In a weakly forced scenario and in the absence of a previous 
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12-hour forecast, a 24-hour COAMPS forecast with its highly developed 
mesoscale structure, should be the background field of choice. 

Warner (1992) and Sashegyi and Madala (1992) feel that local forcing can 
reduce error if the surface parameters are accurately specified and could 
increase the error if poorly specified. Anthes (1986) felt that mesoscale 
simulations are insensitive to random fluctuations in the initial wind, temperature, 
and moisture fields. Instead, he believes they are more sensitive to errors in the 
large-scale flow and to model physics. The large-magnitude errors we observed 
were associated with system crashes, data assimilation, and poor background 
fields. The small-magnitude errors may have been related to model 
parameterizations (surface heat fluxes) and model elevation differences. Since 
we did not observe error growth and we believe that small errors do indeed grow, 
we assume that the limitations of present day numerical mesoscale models and 
data assimilation techniques inhibit observation of random day to day wind and 
temperature fluctuations within a highly variable, weakly forced environment. 

In other words, using these tools in this environment, we have no mesoscale 
analysis skill. 

3. Error Pattern and the Diurnal Cycle: The Link 

TAMS/RT error growth and decay are closely linked to the diurnal cycle. 
Model inconsistencies that follow, but inaccurately capture the diurnal cycle, 
ensure that small-magnitude errors are sustained through the forecast. When 
used as a background field for a warm start, those errors are carried into the 
following model run. The diurnal cycle and repetitive nature of the error pattern 
ensures that large-magnitude errors, regardless of model run, eventually return 
to the norm. Poor data assimilation and/or background field can delay that 
return. 

Figure 7 shows that when compared to observed mean values, wind 
errors account for a large contribution to the observed mean wind. Temperature 
errors meanwhile, account for a smaller error contribution. The synoptic scale 
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west/east geostrophic pressure gradient explains why mean observed and error 
values for east/west wind (u) are higher than north/south (v). Also, it may explain 
why errors are higher during the warming cycle (daytime) when higher inland 
temperatures drive strong onshore westerly winds that interact with coastal 
topography and generate a complex inland wind flow with high variability and 
thus, high error. At night, inland areas cool and a stable boundary layer forms. 
Wind flow is light and less variable (i.e., interacts less with topography) and 
results in lower errors. Any variations between model and actual topography 
accentuate the error. 

B. THE FORECASTING CHALLENGE 

How does a forecaster adjust a mesoscale forecast using an analysis 
embedded with relatively large errors? Does the traditional comparison of 
analysis with satellite, previous model run, other models, or even observations 
really help? 

There are some clues. An analysis that is smoother than the previous 12- 
hour forecast probably has large-scale errors. Nonetheless, even a well-defined 
mesoscale analysis will have errors and in a weakly forced mesoscale 
environment and those small-magnitude errors (especially wind) are relatively 
large compared to observed mean values. 

The challenge lies in understanding error and its relationship to: 

- Cold versus warm starts . Both can introduce large-magnitude errors 
depending on quality of background fields and data assimilation. A cold start 
may be better in a strongly forced synoptic situation while a warm start may be 
preferable in a weakly forced one. Ideally, the forecaster should be able to 
decide which initiaiization scheme to use depending on the current synoptic 
trends, i.e., wintertime with frequent frontal passages, or summertime with light 
forcing and mesoscale influence. 
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- Background fields . As noted above, in a weakly forced environment, a 
24-hour mesoscale forecast with high-resolution mesoscale structure may be 
preferable to a smoother 12-hour global scale forecast. 

- Data assimilation . The true nature of the data assimilated into a 
particular model run is unknown to the forecaster. Depending on quality of data, 
it can greatly influence the magnitude of the analysis and forecast errors within 
all or part of the domain, sometimes or all the time. 

- Model physics and parameterization inaccuracies . Elevation differences 
between model and reality can account for diurnal inaccuracies in model 
temperature and wind fields. In a certain season, a simple temperature 
correction may actually degrade the forecast. 

C. AREAS FOR FURTHER STUDY AND RECOMMENDATIONS 

Based on our findings, we believe the following areas warrant further 
consideration. 

1. Continue to Collect Fall and Winter Error Statistics for NMPOC 
San Diego. 

Error may increase or decrease under strong synoptic forcing. 

Regardless, will the diurnal error pattern still be evident? 

2. Evaluate the Average Trends We Observed at Other Locations. 

Different locations may have similar tendencies. We recommend 
collecting statistics for those locations and assessing average trends. In this 
manner, a large database can be constructed that highlights model tendencies in 
certain areas during certain conditions and times. For example, errors due to 
model inconsistencies in following the diurnal cycle may be quite similar in areas 
around the Mediterranean and Persian Gulf. This could lead to a similar error 
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pattern at inland areas during the height of daytime or seasonal heating than we 
observed. 

3. Reevaluate Data Assimilation Schemes. 

Data assimilation with NMPOC’s TAMS/RT varies daily and its forecast 
impact is difficult to assess. Better documentation of the data that is assimilated 
along with the influence of different types of data and their impact on analysis 
and forecast error is needed. 

For example, under the present scheme does initializing a model run with 
few or even several local surface observations make a difference? 

Approximately 800 to 1500 NOGAPS pseudo-raob data points are assimilated 
into each run. This may be introducing NOGAPS bias into the mesoscale 
forecast. Hovermale (1986) feels that any smoother, larger scale circulation 
analyzed aloft will quickly destroy or rearrange any fine detail introduced into the 
initial conditions at the surface alone. 

4. Evaluate the Effects of Lateral Boundary Conditions. 

The influence of lateral boundary conditions (LBC) on the inner nest is 
unclear. A better understanding of LBC error contribution, if any, is needed. 

NOGAPS lateral boundary conditions update TAMS/RT every 12 hours 
(tau 12). We report one case (April) where the forecast changes notably in six 
hours even though only very limited data assimilation (pseudo-raobs only) took 
place. This change could have been due to model physics or the pseudo-raobs, 
but it also may be possible that insufficient spacing from the mother grid allowed 
lateral boundary conditions to influence the inner nest. 

5. Account for Large Anaiysis Error. 

We have showed that the analysis contains relatively large errors when 
compared to mean observed values. These large errors can degrade the 
TAMS/RT NOWCAST analysis, which is a mesoscale analysis with the best 
estimate of current environmental conditions within the domain (NRL TAMS/RT 
webpage 1999). It is designed to assist the tactical forecaster with critical 
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forecasts. For example, in a light wind scenario, if 33 knots of relative wind are 
required to recover aircraft and the ship can only maintain 30 knots of speed. A 
1-2 m/s (2-4 knots) error from an unexpected direction can be detrimental. 

During the day, we’ve shown analysis error values up to 1 m/s (2 knots) that 
comprise 26 to 36% of the mean observed values. At night those values change 
to 0.5 m/s (1 knot) or 147 to 300% of the mean observed value! 

In view of large-scale data assimilation that might be occurring, updating 
TAMS/RT with local observations may have little affect. 

6. Establish a TAMS/RT Working Group at NPS and NRL 

Installation of TAMS/RT at various sites is well underway. We 
recommend statistical analysis of areas of forecasting interest in order to 
determine and quantify average trends. Manpower and technical ability limits 
this type of analysis at Naval METOC Centers. We have shown that there is 
much to learn about mesoscale model forecasting and data assimilation that 
needs to be done in a research environment rather than in the field. 

NPS and NRL can work in concert to collect, analyze, test, recommend 
and implement changes that will improve our ability to serve the fleet. 
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APPENDIX A. TABLES 


The following pages of tables are grouped together in this appendix 
to help make reading them easier. 
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Table I: COAMPS General characteristics and specific configuration for NPMOC 
San Diego’s TAMS-RT. From ref. [Reiss 19991. 


QUALITY CONTROL 


Observations 



Alqorithms for atmospheric observational data (Baker 1992 




ANALYSIS 


Levels 


Synthetic observations 


First-guess fields 


MVOI of winds and heights 


Volume method 


Input 


D-values/Thickness 


Superobs 



ATMOSPHERIC 

MODEL 


Dynamics, Numerics: 




Grid configuration 


Vertical coordinates 



Grid proiection 


Mesh ratio 


Grid spacing 


Analysis on 16 standard pressure levels (1000 MB to 10 MB 


Synthetic observations from NOGAPS in data sparse regions. 


• NOGAPS for cold starts, 

• COAMPS for warm starts (data assimilation 


Lorenc technique (1986) for mapping obs to the model grid(s 


Adjustable volume size for a separate analyses on each nested grid 


Synoptic, ship, bathymetric, ice, radiosondes, pibals, AIREPS, 
ACARS, SSMI, surface and cloud track winds, and synthetic 
observations. 


Radiosondes, DMSP, NOAA satellite. 


Aircraft and SSMI. 


Cressman (1959). Radiosonde and synthetic observations only with 
gross-error checking. 




• Non-hydrostatic compressible equations (Klemp and Wilhelmson 
1978). 

• Equations also include map factors, terrain, lateral, lower, and 
upper boundary conditions and are solved using a combination of 
finite differencing, finite elements, and spectral methods. 

• Time-splitting method in horizontal allows large time steps for 
slow modes and small time steps for fast modes. Semi-impiicit 
method in vertical. 


Horizontal diffusion (4 order difference method) is used to control 
spurious, high frequency waves that are not important for the final 
solution. _ 

• Staggered C grid (Arakawa and Lamb (1977)) 

• Multiple nested grid options. _ 

Terrain following coordinate (sigma z; Gal-Chen and Somerville 1975) 
allows flow over an irregular surface. 


• 30 sigma levels (m) with higher density in lower troposphere 

• Levels at (m): 10, 30, 55, 90,140, 215, 330, 500, 750, 1100, 
1600, 2300, 3100, 3900, 4800, 5800, 6800, 7800, 8675, 9425, 
10175, 10925, 11675, 12425, 13300, 14300, 16050, 19400, 
24400, 31050. 

• Note: TAMS-RT allows the user to change the vertical coordinate 
system from these default values. 


Lambert conformal, mercator, or spherical. 


3:1 


• Synoptic to LES. 

• Note: NPMOC San Diego’s TAMS-RT settings for thesis case 
studies were 45,15, and 5 km’s (coarse/medium/fine). 





























Precipitation Physics 


Grid spacing > 10km 

• Stratiform: Explicit moist physics (Rutledge and Hobbs 1983). 

• Convective: Kain and Fritsch (1993) cumulus parameterization. 

Grid spacing < 10km 

• Rutledge and Hobbs (1983) explicit moist physics for both 
stratiform and convective clouds and precipitation . 

• For grid resolutions < 10km, COAMPS is effectively acting as a 
cloud model. 

Options for COAMPS 

SP (simplified physics) 

• Stratiform: Instantaneous condensation/fallout. 

• Convective: Kuo (1974) cumulus parameterization. 

• Note: NPMOC San Diego’s TAMS-RT did not employ SP. 

Known characteristics 

• Kain and Fritsch: under-predicts and noisy over ocean 

• Kuo: over-predicts, dependent upon grid resolution, and 3-5 times 
faster than KF. 

Radiation 

Radiative transfer parameterization (Harshvardan et al. 1987) 

Boundary layer and 
surface parameterizations 


Land-use 

Surface albedo 

Surface roughness 

Ground wetness 

Ground temperature 

SST 

• Initially taken from a global monthly climatology database 
(resolution ~ 1® lat) and thereafter from the previous forecast. 

• In certain regions, USGS 1-km global land-use database 
remapped to 0.01° resolution replaces climatology fields. 

• Look up table assigns each land-use type (1-94) a value of 
ground wetness, albedo (open sea = 0.09; ice = 0.6), and surface 
roughness based primarily on Henderson-Sellers and Wilson 
(1986). Values are averaged at 0.01° resolution over each of the 
COAMPS domains to determine one value of each for every 
COAMPS grid point. 

• Note: NPMOC San Diego’s TAMS-RT now uses a 1-km global 
land-use database and a CODA SST and ice analysis updated 
twice daily. This value is held constant throughout each forecast 
cycle. 

Turbulence 

1.5 order, level 2.5 TKE Closure (Mellor and Yamada 1982) 

Surface Layer 


Terrain and coastal source 
and resolution 

• Grid spacing > 20km: Uses 20-km terrain database bilinearly 
interpolated to the grid resolution. 

• Grid spacing < 20km: Uses 1-km terrain database (NIMA level 1) 
bilinearly interpolated to the grid resolution. 

• Terrain matching employed across mesh boundaries. 

• Note: NPMOC San Diego’s TAMS-RT uses 1-km global terrain 
and 400-m coastal databases. 

Lateral Boundary 

Conditions 


Time dependent 
boundary conditions 

Davies (1976) or optionally Perkey-Kreitzberg (1976) interpolated 
from NOGAPS (16 or 21 levels) available in temporal resolutions of 
hourly or in multiples thereof. Options for periodic, radiation, or fixed 
in idealized simulations. Option for sub-nesting local COAMPS 
domains within coarser regional domains. 

Note: NPMOC San Diego uses Davies method, 16-level, 12-hour 
temporal resolution lateral boundary conditions (LBCs) from 

NOGAPS. COAMPS is typically triply nested and the LBCs of the 
inner meshes are updated at the model time step. Only the outer 
coarse mesh "sees" the NOGAPS LBCs. 
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Table II. Outer nest (45 or 54 km) surface pressure comparison between 
verifying analysis and OOz and 122 model run forecasts (f12 and f24) for best fit 
over SOCAL area. 


OOZ 

model 

run 

#of times 
fl2 has 
lower 
pressure, 

VT: 12z 

No. 

cases 

#of times 
f24 has 
lower 
pressure, 

VT: OOz 

No. 

cases 

£24 

better 
£it than 
£12 

No. 

cases 

MAY 

100.00% 

9 

66.00% 

9 

55.00% 

9 

JUN 

100.00% 

8 

88.00% 

8 

66.00% 

9 

JUL 

100.00% 

18 

74.00% 

19 

77.00% 

17 

AUG 

92.00% 

13 

62.00% 

13 

73.00% 

11 

SEP 

87.00% 

15 

23.00% 

13 

54.00% 

13 

Ave 

95.80% 

63 

62.60% 

62 

65.00% 

59 

St dev 

6.02% 


21.70% 


10.37% 



12Z 

#of times 

No. 

#of times 

No. 

£12 

No. 

model 

fl2 has 

cases 

£24 has 

cases 

better 

cases 

run 

lower 


lower 


£it than 



pressure. 


pressure. 


£24 



VT: OOz 


VT: 12z 




MAY 

25.00%' 

8 

100.00% 

1 

100.00% 

1 

JUN 

78.00% 

9 

100.00% 

8 

100.00% 

1 

JUL 

35.00% 

17 

100.00% 

13 

94.00% 

17 

AUG 

25.00% 

12 

89.00% 

9 

90.00% 

10 

SEP 

25.00% 

8 

86.00% 

7 

87.00% 

8 

Ave 

37.60% 

54 

95.00% 

44 

94.00% 

49 

St dev 

23.00% 


6.93% 


5.61% 
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Table III. Inner nest relative error (bias) contribution to mean observed 
values of u, v, and T for analysis (fOO) of each model run. 


Variable 
per model run 

Average 

observed 

Average 
Error (bias) 

Average RMS 
Error 

% 

Contribution 

U_00z 

3.68 m/s 

0.97 m/s 

2.71 m/s 

26% 

U_12z 

0.40 m/s 

0.59 m/s 

2.48 m/s 

147% 

V_00z 

0.81 m/s 

0.29 m/s 

2.44 m/s 

36% 

V_12z 

-0.19 m/s 

0.56 m/s 

2.48 m/s 

-294% 

T_00z 

21.68 °C 

2.72 ° C 

4.53°C 

13% 

T_12z 

15.18 °C 

0.58 °C 

3.57°C 

4% 
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Table IV. Average observed and model east/west (u) and north/south (v) wind vector 
direction and corresponding average wind direction and speed for the inner nest. 
Double arrows indicate greater value in order to assess if model is over or 
underforecasting winds. 


Forecast by 
Model Run 

Observed 
vector direction 

U, V 

Model 

vector direction 

U. V 

Observed 
direction 
(^rue) 
speed (m/s) 

Model 
direction 
(‘True) 
speed (m/s) 

OOz Model 





U fOO 



258 

259 

V_f00 

tt 

t 

3.77 

2.77 

U f06 



278 

291 

V_f06 

i 

U 

1.25 

1.05 

U f12 


<- 

295 

193 

V_f12 

4 ^ 

u 

0.44 

0.68 

U f18 


— ^ 

244 

256 

V_f18 

n 

t 

2.04 

0.90 

U f24 


->■ 

258 

258 

V_f24 

tt 

t 

3.77 

3.01 

12z Model 





U fOO 


<- 

295 

194 

V_f00 


u 

0.44 

0.77 

U f06 



244 

255 

V_f06 

tt 

t 

2.04 

1.03 

U f12 


-» 

258 

259 

V_f12 

tt 

t 

3.77 

2.97 

U f18 


-> 

278 

298 

V_f18 

i 

tt 

1.25 

1.18 

U f24 


<- 

295 

183 

V_f24 


tt 

0.44 

0.75 
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station Model Actual 
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APPENDIX B. FIGURES 

The following pages of figures are grouped together in this appendix 
to help make reading them easier. 



Figure 1. NPMOC TAMS/RT horizontal grid domain, 45/15/5 km. 
Domain sizes were changed to 54/18/6 km on 18 June 1999. From ref. 
[Reiss 1999]. 
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Figure 2. VISUAL plot for 27 August 12z model run, 12-hour (fl2) 
forecast and 28 August analysis (fDO). Wind in knots, temperature at 2 °C 
isotherms. 


44 









Figure 3. VISUAL plot for inner nest (5 km) depicting model topography 
and various reporting stations. Contour interval of 75 meters. 
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Spring, fOO - Daily average U Error 
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Figure 5a. Spring time series: analysis (fOO), 
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Figure 6. Inner nest forecast cycle error growth for spring and summer. Error bars 
are shown for spring v vector, and summer temperature only (other variables have 
similar magnitudes) 
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Average Error m/sordegC 


OOz Model Run 


Mean observed u,v,T(% error contribution): 



fOO/OOZ f06/06Z fl2/12Z fl8/18Z C4/00Z 


— u error —■—error —A—error 


12z Model Run 

Mean observed u,v,T(% error contribution): 


T= 15.2(4%).20.4(16%).21.7(13%).16.7(9%).15.2(6%) 



fD0/12Z f06/18Z fl2/00Z fl8/06Z C4/12Z 


Forecast / Valid time 

Figure 7. Error growth by model nm for inner nest. Meanobserved values of u, v, 
and T are given to show relative contribution of error. 
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OOZ 06Z 12Z 18Z 

Figure 8. Model versus observed average variability for the inner nest. 
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Figure 9. Outer nest (45 km) sea level pressure forecast for 11 April OOz 
fl2 (12-hour forecast = solid line), and model analysis for 11 April 12z 
fDO (dashed line). Contour interval = 2 mb. 
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Figure 10. VISUAL plot for inner nest, 11 April OOz model run, 12 and 
IS-hoiff forecast (fl2 and fl8). Contour interval of 2 °C. 
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Figure 11. VISUAL plot for inner nest, 11 April 12z model run, analysis 
and 6-hour forecast (fOO and f06). Contour interval of 2 °C. 
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Figure 12. Outer nest (45 km) sea level pressure forecast for 13 June 12z 
fl2 (12-hour forecast = solid line), and model analysis for 14 Jime OOz fDO 
(dashed line). Contour interval = 2 mb. 
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OOz, August, fOO - Daily average U Error 



Figure 13a. August time series: OOz model run analysis (fOO) with full and limited data assimilation (DA) highlighted. 

















































12z, August, fOO - Daily average U Error 



August 1999 

Figure 13b. August time series: 12z model run analysis (fDO) with full and limited data assimilation (DA) highlighted. 





















002 , September, fOO - Daily average U Error 



September 1999 

Figure 14a. September time series: OOz model run analysis (fDO) with foil and limited data assimilation (DA) highlighted, 















































Figure 14b. September time series: 12z model ran analysis (fOO) with full and limited data assimilation (DA) highlighted. 
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Figure 15. VISUAL plot for inner nest, 16 August 12z model run, analysis 
and 6-hour forecast (fDO and fD6). Contour interval of 2 °C. 
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Figure 16. VISUAL plot for inner nest, 16 August 12z model run, 12-hour 
(fl2) forecast and 17 August OOz model run analysis (fDO). Contour 
interval of 2 ®C. 
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N2r/ 2aAUG 12Z- Observed and Model U Vector 



NZY 28AUG 12Z- Observed and Model Temperature 



NZY 29AUG OOZ- Observed and Model U Vector 



Figure 17a. North Island (NZY) time series for u, v, and T for 28/12z and 29/OOz model runs 
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RIV 28AUG 12Z- Observed and Model U Vector 



RIV 29AUG OOZ- Observed and Model V Vector 



Figure 17b. Riverside (RIV) time series for u, v, and T for 28/12z and 29/OOz model runs. 


65 



















































































OOz, Inland Stations - Daily average T error 



Figure 18. Temperature time series for Inland and San Diego Stations: OOz model run forecast. 






























12z, Inland Stations - Daily average T error 



Figure 18b. Temperature time series for Inland and San Diego Stations: 12z model run forecast. 
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•Station elevation: 469 m = 623m difference or ~ 3 ®C 


Figure 19. Riverside (RIV) temperature error growth for spring and summer. 
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